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All  applicants  for  military  service  are  required  to  achieve  a  minimum  score 
on  the  Armed  Forces  Qualification  Test  (AFQT)  to  be  eligible  for  enlistment.  The 
AFQT  is  a  composite  score  derived  from  four  of  the  subtests  of  the  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB) .  Applicants  for  the  Army  also  have  to  qthleve 
■rtr.-tmmi  scores  on  Army  Aptitude  Area  Composites  which  are  various  combinations  of 
the  ASVAB  subtests. 

v  The  traditional  Enlistment  Screening  Test  (EST)  used  by  recruiters  for  all 
military  services  to  screen  service  applicants  for  potential  failure  has  been 
designed  to  predict  the  AFQT  score  (Bayroff ,  Thomas  &  Kehr,  1959;  Jensen  & 
Valentine,  1976;  Mathews,  1981;  Morton  &  Houston,  1957).  The  U.S.  Army  Research 
Institute  (ARI)  has  developed  a  Pre-enlistment  Recruiting  Test  (PERT)  to  predict 
ASVAB  Army  Aptitude  Area  Composite  scores,  as  well  as  scores  on  the  AFQT.  The 
PERT  mini-battery  is  a  shorter  but  parallel  version  of  the  operational  ASVAB. 

PERT  scores  will  be  used  within  the  Army's  new  Joint  Optical  Information  Network 
(JOIN)  system,  a  system  using  mini-computers  with  video  display  capabilities  for 
use  in  Army  recruiting  stations.  PERT-derived  Aptitude  Area  scores  will  allow 
a  recruiter  to  discuss  particular  Military  Occupational  Specialties  (MOS)  for 
which  an  applicant  might  be  most  qualified. 

This  paper  presents  preliminary  results  of  the  criterion-related  validation 
of  the  PERT  against  the  operational  ASVAB. 
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Method 


Instrument 

The  PERT  was  developed  during  the  fall  of  1980.  Table  1  presents  the 
correspondence  between  the  subtests  of  the  PERT  and  the  operational  ASVAB  8/9/10. 
The  80  Items  comprising  the  eight  non-speeded  PERT  subtests  were  collected  as 
follows.  Forty  items  were  from  ASVAB  Form  2  and  four  Items  from  ASVAB  Form  1. 
Twenty  six  Items  were  original  and  ten  Paragraph  Comprehension  items  were  obtained 
from  a  cross-section  of  three  experimental  Enlistment  Screening  Test  (EST) 
booklets  (Mathews,  1981).  All  of  the  72  Coding  Speed  (CS)  items  were  original. 
None  of  the  PERT  items  is  in  the  operational  ASVAB. 

There  are  three  differences  between  the  PERT  and  ASVAB.  First,  the  PERT 
has  no  equivalent  subtest  for  Numerical  Operations  (NO) .  The  Coding  Speed  (CS) 
subtest  in  PERT  substituted  for  both  the  CS  and  NO  in  the  operational  ASVAB. 

While  the  correlation  between  CS  and  NO  in  the  operational  ASVAB  is  only  .64, 
the  patterns  of  correlations  between  these  two  speeded  subtests  with  the  non- 
speeded  ASVAB  subtests  are  quite  similar  (see  Table  K-3  in  Sims  and  Truss ,  1980) . 
Second,  the  PERT  subtests  have  fewer  items  than  the  ASVAB  subtests.  Third,  the 
items  for  the  PERT  subtestu  are  not  presented  as  separate  content  areas  nor  are 
they  independently  timed.  The  one  exception  is  the  PERT  subtest  for  Coding 
Speed  which  is  presented  in  a  separate  booklet  (Test  Book  II)  and  has  a  five 
minute  time  limit.  The  other  PERT  subtest  items  are  sequentially  presented  in 
Test  Book  I  such  that  three  items  from  a  subtest  are  followed  by  three  items 
from  the  next  subtest.  This  sequencing  continues  until  nine  items  frcm  each 
of  the  subtests  are  presented.  The  last  eight  items  of  the  80  items  ii  Test 
Book  I  are  the  successive  presentations  of  the  10th  Items  In  each  of  the  eight 
PERT  subtests.  The  major  advantage  is  that  the  recruiter  does  not  need  to  monitor 
time  limits  nor  give  specific  directions  for  each  subtest.  The  examinee  is 
provided  with  initial  directions  and  example  problems  and  allowed  to  complete 
Test  Book  I  (all  subtests  except  CS)  in  50  minutes.  In  the  event  a  slower 
examinee  does  not  finish,  each  subtest  should  be  affected  about  equally. 

The  examinee  is  then  provided  with  Test  Book  II,  and  allowed  five  minutes 
to  answer  the  72  CS  items. 

Procedure 

In  March  of  1981,  the  U.S.  Army  Recruiting  Command  (USAREC)  tasked  each 
of  the  57  District  Recruiting  Commands  (DRC's)  to  select  10  of  the  recruiting 
stations  in  their  districts  to  participate  in  the  research  project.  This  would 
yield  a  total  of  570  recruiting  stations.  They  were  selected  in  the  following 
manner.  First,  all  recruiting  stations  which  had  station  commanders  who  were 
not  on  production  were  identified.  (Non-production  station  commanders  are  not 
directly  involved  in  soliciting  applicants).  Second,  within  each  DRC,  up 
to  10  recruiting  stations  were  randomly  selected.  The  DRC's  and  their  designated 
recruiting  stations  participated  in  the  study  until  each  station  commander 
tested  15  applicants  and  forwarded  to  the  DRC  15  complete  and  usable  answer 
sheets.  Each  DRC  then  forwarded  all  answer  sheets  to  ARI. 


Table  1 


Correspondence  Between  the  PERT  and 


ASVAB  Subtests 


Subtest 

Number 
of  Items 

Name 

Content 

ASVAB 

PERT 

Word  Knowledge  (WK) 

Understanding  the  meaning 
of  words,  i.e.  vocabulary 

35 

10 

Arithmetic  Reasoning  (AR) 

Word  problems  emphasizing 
mathematical  reasoning 
rather  that  mathematical 
knowledge 

30 

10 

Paragraph 

Comphrehenslon  (PC) 

Understanding  the  meaning 
of  paragraphs 

15 

10 

Numerical  Operations  (NO) 

A  speeded  test  of  four 
arithmetic  operations, 
i.e.,  addition,  subtrac¬ 
tion,  multiplication  and 
division 

50 

None 

Mechanical 

Comprehension  (MC) 

Knowledge  of  general  mechnlcal 
and  physical  principles 

25 

10 

Electronics 

Information  (El) 

Knowledge  of  electronics  and 
radio  principles 

20 

10 

Auto-Shop  Information  (AS) 

Knowledge  of  auto  mechanics, 
shop  practices  and  tool  functions. 

25 

10 

Mathematics  Knowledge  (MK) 

Knowledge  of  algebra, 
geometry  and  fractions 

25 

10 

General  Science  (GS) 

Knowledge  of  the  physical 
and  biological  sciences 

25 

10 

Coding  Speed  (CS) 

A  speeded  test  of  matching 
words  and  numbers 

84 

72 
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During  the  last  week  In  April,  each  of  the  designated  station  commanders 
was  sent  a  packet  of  materials  which  Included:  a  letter  explaining  the  purpose 
of  the  research  project;  PERT  Test  booklets  and  IBM  scorable  answer  sheets; 
test  administration  Instructions.  The  station  commanders  were  Instructed  to 
administer  the  PERT  to  all  applicants.  An  individual  was  defined  as  an  applicant 
when  a  recruiter  completed  a  USAREC  Form  714  for  the  individual.  (A  Form  714  is 
completed  on  applicants  who  are  intending  to  be  tested  by  the  operational  ASVAB) . 
After  that  time,  and  before  the  applicant  received  the  operational  ASVAB,  the 
station  commander  administered  the  PERT  and  had  the  applicant  record  all  responses 
on  a  single  answer  sheet.  The  testing  room  normally  used  by  the  recruiters  at 
the  recruiting  station  was  used  for  this  purpose. 

Subjects 

This  procedure  yielded  2,921  answer  sheets  returned  to  ARI.  Nineteen  of 
these  were  dropped  due  to  missing  social  security  numbers.  The  distribution 
of  the  remaining  2,902  responses  by  DRC  and  Regional  Recruiting  Command  (RRC) 
are  presented  in  Tables  2  and  3,  respectively.  A  large  portion  of  the  PERT 
testing  was  completed  in  May  with  the  remainder  finishing  in  June.  Accordingly, 
for  data  analyses  the  May  applicants  were  treated  as  the  developmental  sample 
and  the  June  applicants  as  the  validation  sample.  The  criteria,  the  actual 
ASVAB  test  results,  were  obtained  from  the  Military  Processing  Command  (MEPCOM) 
for  the  May  and  June  applicants.  When  the  social  security  numbers  were 
matched  against  those  on  the  MEPCOM  tapes,  1,058  and  478  matches  were  found 
for  the  May  and  June  applicants  respectively.  The  applicants  who  had  results 
for  tests  other  than  ASVAB  8/9/10  were  dropped,  yielding  developmental  and 
validation  samples  of  1,047  and  473  respectively.  The  distribution  of  these 
two  Samples  with  respect  to  the  DRC  where  PERT  was  administered  is  also  presented 
in  Tables  2  and  3. 

An  inspection  of  Table  2  indicates  that  the  applicants  tested  were 
nationally  distributed  with  no  apparent  regional  biases.  Table  3  summarizes 
these  data  with  respect  to  the  five  recruiting  regions.  Comparing  the  percent 
of  matched  returns  between  the  developmental  and  validation  sample  in  each 
region  highlights  a  problem  with  using  month  of  testing  as  the  basis  for  dividing 
the  total  sample  into  a  developmental  and  validation  sample.  Since  the  majority 
of  the  applicants  in  the  Northeast  and  Southeast  Regions  were  tested  early 
(i.e.,  in  MayX  these  two  regions  are  over-represented  in  the  developmental 
sample  and  under-represented  in  the  validation  sample.  Just  the  opposite 
occurred  for  the  Southwest,  Midwest  and  Western  Regions.  While  this  unequal 
distribution  is  unfortunate,  it  will  serve  to  make  the  validation  of  the 
regression  weights  computed  in  the  developmental  sample  a  more  stringent  test, 
since  the  validation  sample  may  be  less  similar  to  the  developmental  sample. 

This  will  tend  to  decrease  the  size  of  the  cross-validated  Regression 
Coefficients.  To  ascertain  the  extent  to  which  the  developmental  and  validation 
samples  differed,  demographic  characteristics  and  AFQT  scores  were  examined 
for  each,  sample. 
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Table  2 


The  Number  of  Applicants  Tested  on  the 
PERT  In  Each  District  Recruiting  Command  (DRC) 


Number  of  Applicants 
Matched 


Number  of  Applicants 
Matched 


"District 

Recruiting  T 

Command  w 

% 

Northeast  Region 

Idlbany 
Baltimore 
Jos  ton 
/Concord 
'  Harrisburg 
CNew  Haven 
>\ong  Island 
■  tfewburg ,  NT 
-ft.  Monmouth,  NJ 
*  llagara  Falls 
".Philadelphia 
■Pittsburg 
Syracuse 

K  Total 


with  ASVAB 

District 

with  ASVAB 

Tested 
with  PERT 

Develop¬ 

mental 

Validation 

Recruiting 

Command 

Tested 
with  PERT 

Develop¬ 

mental 

Validation 

28 

13 

Southeast  Region 

Atlanta 

34 

14 

33 

15 

4 

Beckley 

— 

— 

— 

33 

9 

1 

Charlotte 

75 

24 

3 

25 

16 

— 

Columbia 

76 

17 

3 

49 

30 

1 

Jacksonville 

53 

29 

7 

28 

7 

— 

Louisville 

12 

8 

5 

103 

37 

1 

Miami 

81 

40 

6 

39 

22 

— 

Montgomery 

58 

18 

5 

— 

— 

— 

Nashville 

90 

27 

13 

67 

28 

— 

Raleigh 

108 

37 

2 

81 

28 

2 

Richmond 

15 

6 

7 

29 

14 

— 

San  Juan 

85 

9 

19 

87 

31 

— 

Total  687 

229 

70  - 

-Southwest  Region 


llbuquerque 

31 

11 

3 

"alias 

67 

29 

6 

caver 

18 

1 

3 

ouston 

43 

17 

8 

ackaon 

34 

13 

5 

ansas  City 

46 

28 

10 

, lttle  Rock 

7 

8 

15 

w  Orleans 

31 

18 

6 

jclahoma  City 

64 

18 

17 

‘.an  Antonio 

43 

15 

9 

Total 

384 

158 

82 

Table  2  (continued) 


Number  of  Applicants 

Number 

of  Applicants 

-■  A 

Matched 

Matched 

m 

District 

with  ASVAB 

District, 

with  ASVAB 

Recruiting 

Tested 

Develop- 

Recruiting 

Tested 

Develop- 

Command  (DRC) 

with  PERT 

mental  Validation 

Command  (DRC) 

with  PERT 

mental  Validatiot  < 

Midwest  Region 

Western  Region 

“  ‘-*3  1 

Chicago 

27 

6 

9 

San  Francisco 

72 

32 

14 

t  sl 

Cincinnati 

57 

23 

15 

Honolulu 

— 

— 

— 

<  ' 1  *  "* 

Cleveland 

105 

31 

31 

Los  Angeles 

40 

14 

4 

•I’/.* 

Columbus 

99 

44 

*22 

Phoenix 

72 

17 

19 

» "  ’.'"i 

Des  Moines 

16 

9 

7 

Portland 

23 

5 

6 

i  * « 

Detroit 

27 

11 

7 

Sacramento 

59 

10 

19 

Indianapolis 

60 

27 

16 

Salt  Lake  City 

25 

11 

5 

Lansing 

39 

11 

11 

Santa  Ana 

89 

21 

21 

Milwaukee 

72 

30 

17 

Seattle 

45 

19 

19 

'X*  i 

Minneapolis 

56 

21 

17 

Total  425 

129 

107 

>\* 

i 

Omaha 

36 

17 

12 

Peoria 

78 

24 

26 

»*1*  * 

St.  Louis 

56 

21 

11 

Total 

728 

275 

201 

'•V- 

Table  3 


The  distribution  of  both  samples  with  respect  to  the  demographic  variables 
of  Gender,  Race  and  Education  information  available  from  the  MEPCOM  tapes,  is 
presented  in  Table  4.  The  validation  sample  includes  a  slightly  higher  proportion 
of  whites  than  the  developmental  sample,  i.e.,  71X  vs.  61%.  The  proportion 
of  males  in  both  samples  is  identical,  78%.  The  distribution  of  applicants  by 
education  for  the  developmental  sample  is  41%  for  high  school  graduates,  14% 
for  high  school  seniors  and  45%  for  those  with  General  Educational  Diplomas  (GED) . 
The  corresponding  distribution  for  the  validation  sample  is  47%,  11%  and  42%. 

Thus,  the  developmental  and  validation  samples  are  similar  with  respect  to 
demographic  characteristics . 

A  critical  dimension  of  both  samples  is  the  range  of  scores  on  the  AFQT 
portion  of  the  operational  ASVAB.  Table  5  reveals  that  the  developmental  and 
validation  samples  are  similar  in  respect  to  AFQT  scores.  Both  samples  Include 
a  large  proportion  (71%  and  67%)  of  applicants  who  scored  below  the  50th 
percentile.  These  proportions  are  fortuitous  for  our  purposes  because  the 
PERT  predictions  will  be  most  useful  for  those  applicants  in  the  lower  ability 
leyels  who  may  not  qualify  for  all  MOS.  In  general,  comparisons  between  the 
developmental  and  validation  samples  Indicate  that  there  does  not  appear  to 
be  any  major  difference  between  the  two  samples,  even  though,  the  two  samples 
were  not  equally  distributed  among  the  five  Recruiting  Regions. 


Analyses 


To  examine  some  psychometric  properties  of  the  PERT,  subtest  scale  means, 
standard  devltlons  and  Cronbach's  coefficient  alpha's,  an  index  of  the  Internal 
consistency  reliability,  were  computed  in  the  developmental  sample.  The 
validation  of  the  PERT  was  accomplished  by  computing  eleven  separate  regression 
equations  in  the  developmental  sample.  For  each  regression  analysis,  the 
PERT  subtest  raw  scores  served  as  the  predictor  variables  and  each  of  the 
ten  Army  Aptitude  Area  Composites  and  the  ATQT  successively  served  as  the 
criterion  variable.  Two  features  of  these  regression  analyses  need  to  be 
explicated.  First,  the  PERT  was  designed  to  predict  Army  Area  Aptitude  Composites, 
not  ASVAB  individual  subtest  scores.  The  ten  Area  Aptitude  Compostles  with 
corresponding  HQS  are  presented  in  Table  6.  Second,  one  PERT  subtest.  Coding 
Speed  (CS),  was  excluded  as  a  predictor  in  the  regression  analyses.  Preliminary 
analyses  of  the  distribution  of  CS  scores  showed  many  high  scores.  The 
distribution  indicated  that  about  half  of  the  applicants  were  apparently  allowed 
to  respond  beyond  the  5-minute  time  of  the  subtest,  thus  invalidating  the  results. 


Once  the  regression  equations  were  computed  in  the  developmental  sample, 
the  regression  coefficients  (non-standard ized  beta  weights)  were  used  to  compute 
predicted  ASVAB  composite  scores  in  the  validation  sample.  The  correlation 
between  the  predicted  and  actual  ASVAB  composite  scores  in  the  validation 
sample  constituted  the  "validated"  multiple  R. 


Table  4 
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The  Distribution  of  the  Developmental 
and  Validation  Samples  with  Respect  to 
Gender,  Race  and  Education 


E  White 


1 


I 


C  Black 


M  Other 


HS  Graduate 


HS  Seniors 


GED 


HS  Graduate 


HS  Senior 


GED 


HS  Graduate 


HS  Senior 


GED 


Validation 


Males 

191 

114 

Female 

61 

41 

Male 

56 

28 

Female 

21 

9 

Male 

227 

124 

Female 

30 

636  (61Z) 

19 

335  (71Z) 

Male 

103 

37 

Female 

60 

19 

Male 

43 

5 

Female 

20 

9 

Male 

108 

43 

Female 

27 

361  (34Z) 

5 

118  (25Z) 

Male 

15 

8 

Female 

4 

2 

Male 

5 

1 

Female 

1 

0 

Male 

22 

8 

Female 

3 

50  (5Z) 

1 

20  (4Z) 

Total 

1,047  (100Z) 

473  (100Z) 
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Results 


Table  7  presents  the  means,  standard  deviations  and  reliability  coefficients 
for  the  PERT  subtests.  Mathematics  Knowledge  (MK)  was  the  most  difficult  of  the 
PERT  power  subtests.  Its  mean  of  3.5  is  substantially  lower  than  the  means  for  the 
other  subtests.  The  mean  and  standard  deviation  for  Coding  Speed  (CS)  is  misleading 
since,  as  mentioned  previously,  many  applicants  were  apparently  allowed  to  go 
beyond  the  specified  time  limit.  The  reliabilities  of  the  power  scales  are  quite 
adequate  for  ten-item  scales. 

Results  of  the  regression  analyses  are  presented  in  Table  8.  The  multiple 
R's  in  the  developmental  sample  were  quite  high,  ranging  from  a  low  of  .73  for 
the  Clerical  (CL)  Aptitude  Area  to  a  high  of  .82  for  the  Skilled  Technician  (ST) 
and  General  Technical  (GT)  Aptitude  Areas  and  the  AFQT.  When  the  regression 
coefficients  were  validated  in  the  second  sample,  multiple  R's  decreased 
only  slightly,  with  the  exception  of  predicting  CL,  which  decreased  from  .73 
to  .63.  In  general,  however,  the  PERT  appears  to  be  a  useful  predictor  of 
Army  ASVAB  composites. 

An  examination  of  the  standardized  beta  weights  for  the  PERT  subtests 
(Table  8)  reveals  that  the  most  useful  subtests  were  Arithmetic  Reasoning  (AR), 

Word  Knowledge  (WK),  Mechanical  Comprehension  (MC)  and  Auto/Shop  Information  (AS) 
followed  by  Math  Knowledge  (MK),  Paragraph  Comprehension  (PC)  and  General 
Science  (GS).  The  PERT  subtest  Electrical  Information  (El)  did  not  achieve 
a  single  beta  weight  above  .10.  Comparisons  of  the  distribution  of  beta  weights 
across  the  PERT  subtests  in  each  regression  equation  with  the  actual  corresponding 
ASVAB  subtests  used  to  compute  ASVAB  composites  (indicated  by  una^rlinings  in 
Table  8) ,  suggests  only  a  moderate  relationship .  This  may  be  the  result  of 
sample  fluctuations  as  the  correlations  of  the  operational  ASVAB  subtests  are 
moderate  to  high  (see  Sims  and  Truss,  1980;  Table  K-3).  It  must  also  be 
noted  that  the  PERT  subtests  are  typically  based  on  half  (or  less)  of  the 
number  of  items  than  the  ASVAB  subtests  and,  consequently,  have  lower  reliabilities. 
The  ASVAB  subtest  scale  reliabilities  range  from  .80  to  .93  (Ree,  Mullins, 

Mathews  and  Massey,  in  press).  This  lower  reliability  of  the  PERT  scales  would 
account  for  some  of  the  coefficient  attenuation. 

Summary  and  Conclusion 

In  this  investigation,  a  newly  developed  test  was  validated.  The  PERT 
was  designed  to  be  used  by  recruiters  to  test  Army  applicants  in  order  to  obtain 
an  indication  of  the  applicant's  eligibility  for  enlistment  as  well  as  for 
specific  MOS.  One  of  the  requirements  for  MOS  entry  is  a  qualifying  score  on 
the  relevant  Army  Aptitude  Area  Composite.  The  PERT  responses  of  1,047  May  1981 
Army  applicants  were  used  to  develop  regret  ion  weights  to  predict  their 
ASVAB  composite  scores.  The  prediction  equations  were  validated  in  an 
Independent  sample  of  473  June  1981  Army  applicants.  The  results  from  this 
research  demonstrate  that  the  PERT  would  be  a  useful  tool  for  recruiters.  The 
final  step  remaining  before  implementation  of  the  PERT  as  an  Army  recruiting 
tool  is  to  equate  the  PERT  scales  to  the  ASVAB  scales .  Recruiters  need  to  know 
what  ASVAB  values  are  predicted  by  which  PERT  values.  This  step  will  be 
compeleted  in  the  near  future. 
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Table  7 


Means,  Standard  Deviations  and  Reliabilities 
of  PERT  Subtest  Scales 


PERT  Subtest  * 

Mean 

Standard 

Deviation 

Coefficient 

Alpha 

Word  Knowledge  (UK) 

5.6 

2.6 

.7A 

Arithmetic 

Reasoning  (AR) 

5.1 

2.6 

.76 

Paragraph 
Comprehension  (PC) 

5.7 

2.6 

.73 

Mechanical 
Comprehension  (MC) 

5. A 

2.3 

.66 

General  Science  (GS) 

5.2 

2.2 

.62 

Electronics 
Information  (El) 

5.0 

2.3 

.60 

Mathematics 

Knowledge  (MK) 

3.5 

2.2 

.6A 

Auto/ Shop 

Information  (AS) 

A. 9 

2.5 

.69 

Coding  Speed  (CS)* 

36.0 

18.1 

Note:  ^All  PERT  subtests  have  10  items  apiece,  except  CS 
which  has  72. 


^Coefficient  Alpha  was  not  computed  for  CS  since  it 
i»  a  speeded  tes*.. 
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my  Aptitude  Area  Composites  from  PERT  Subtest  Scores 
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Footnotes 


The  assistance  of  CPT  David  Duke  of  the  U.S.  Army  Recruiting  Comnand 
in  coordinating  the  distribution  and  collection  of  tests  was  invaluable. 

John  Mathews  with  the  Air  Force  Human  Resources  Lab  was  very  helpful  in 
dlsussion  of  data  collection  procedures  and  providing  Paragraph  Comprehension 
(PC)  items.  Dr.  Kent  Eaton,  with  ARI,  provided  critical  institutional  support 
and  coordination.  The  opinions  expressed  are  those  of  the  authors  and  do  not 
necessarily  reflect  those  of  the  Army  Research  Institute  or  the  Department  of 
the  Army. 

Copies  of  this  paper  can  be  obtained  from  the  senior  author,  U.S.  Army 
Research  Institue,  5001  Elsenhower  Avenue,  Alexandria,  Virginia  22333. 
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